Nonnegative Rank Factorization via Rank Reduction

نویسندگان

  • BO DONG
  • MATTHEW M. LIN
  • MOODY T. CHU
چکیده

Abstract. Any given nonnegative matrix A ∈ R can be expressed as the product A = UV for some nonnegative matrices U ∈ R and V ∈ R with k ≤ min{m, n}. The smallest k that makes this factorization possible is called the nonnegative rank of A. Computing the exact nonnegative rank and the corresponding factorization are known to be NP-hard. Even if the nonnegative rank is known a priori, no simple numerical procedure exists that can calculate the nonnegative factorization. This paper is the first to describe a heuristic approach to tackle this difficult problem. Based on the Wedderburn rank reduction formula, the idea is to recurrently extract, whenever possible, a rank-one nonnegative portion from the previous matrix, starting with A, while keeping the residual nonnegative and lowering its rank by one. With a slight modification for symmetry, the method can equally be applied to another important class of completely positive matrices. Numerical testing seems to suggest that the proposed algorithm, though still lacking in rigorous error analysis, might serve as an initial numerical means for analyzing the nonnegative rank factorization.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fast Nonnegative Matrix Factorization with Rank-one ADMM

Nonnegative matrix factorization (NMF), which aims to approximate a data matrix with two nonnegative low rank matrix factors, is a popular dimensionality reduction and clustering technique. Due to the non-convex formulation and the nonnegativity constraints over the two low rank matrix factors (with rank r > 0), it is often difficult to solve NMF efficiently and accurately. Recently, the altern...

متن کامل

Lower bounds on matrix factorization ranks via noncommutative polynomial optimization

We use techniques from (tracial noncommutative) polynomial optimization to formulate hierarchies of semidefinite programming lower bounds on matrix factorization ranks. In particular, we consider the nonnegative rank, the positive semidefinite rank, and their symmetric analogues: the completely positive rank and the completely positive semidefinite rank. We study the convergence properties of o...

متن کامل

On Reduced Rank Nonnegative Matrix Factorization for Symmetric Nonnegative Matrices

Let V ∈ R be a nonnegative matrix. The nonnegative matrix factorization (NNMF) problem consists of finding nonnegative matrix factors W ∈ R and H ∈ R such that V ≈ WH. Lee and Seung proposed two algorithms which find nonnegative W and H such that ‖V −WH‖F is minimized. After examining the case in which r = 1 about which a complete characterization of the solution is possible, we consider the ca...

متن کامل

Heuristics for exact nonnegative matrix factorization

The exact nonnegative matrix factorization (exact NMF) problem is the following: given an m-by-n nonnegative matrix X and a factorization rank r, find, if possible, an m-by-r nonnegative matrix W and an r-by-n nonnegative matrix H such that X = WH . In this paper, we propose two heuristics for exact NMF, one inspired from simulated annealing and the other from the greedy randomized adaptive sea...

متن کامل

A Symmetric Rank-one Quasi Newton Method for Non-negative Matrix Factorization

As we all known, the nonnegative matrix factorization (NMF) is a dimension reduction method that has been widely used in image processing, text compressing and signal processing etc. In this paper, an algorithm for nonnegative matrix approximation is proposed. This method mainly bases on the active set and the quasi-Newton type algorithm, by using the symmetric rank-one and negative curvature d...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008